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1  .  Introduction 

1 ;A  We  propose  to  outline  a  method  for  deriving  optimal 
rules  for  inventory  policy.  The  problem  of  inventories  exists 
not  only  for  business  enterprises  but  also  for  non-profit 
agencies  such  as  governmental  establishments  and  their  various 
branches.  Moreover,  the  concept  of  inventories  can  be  gener¬ 
alized  so  as  to  include  ,not  only  goods  but  also  disposable 
reserves  of  manpower  as  well  as  various  stand-by  devices,  also, 
W'hile  inventories  of  finished  goods  present  the  simplest  problem, 
the  concept  can  be  extended  to  goods  which  can  be  transformed, 
at  a  costj  into  one  or  more  Kinds  of  finished  goods  if  and  when 
the  neea  for  such  goods  arises.  The  following  notes  prepare 
the  way  for  a  more  gener-al  analysis  of  ’’flexible  planning.” 

1 :B  We  shall  make  explicit  use  of  the  concepts  of  proba¬ 
bility  and  utility.  Probaoiiities  enter  because  at  least  some 
of' those  variables  that  are  not  controlled  by  the  policymakert 
are  random  variables.  Of  these,  the  quantity  demanded  (from 
him)  per  unit  of  time  is  the  principal  one.  Some  other  variables, 
such  as  the  purchase  price,  or  the  time  required  for  the  fulfill¬ 
ment  of  an  order  (’’pipeline  time”)  may  also  be  random,  but  will 
not  be  considered  as  such  in  the  present  paper. 

1 :C  If  the  future  were  certain,  the  policymaker  would 
determine  the  variables  under  his_  control  —  for  example,  the 
amounts  he  orders  —  in  such  a  way  as  to  maximize  a  certain 
quantity,  called  net  utility  (or  minimize  its  negative,  cal:led 
net  aamage ,  or  net  loss).  In  enterprises  run  for  profit,  the 
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total  money  profit  earned  over  a  long  period  of  time  (with 
future  profits  possibly  converted  into  present  values  by  using 
a  time— discount  factor  based  on  some  appropriate  rate  of 
interest)  is  a  convenient  measure  of  net  utility.  Accordingly, 
most  of  the  existing  writings  on  the  inventory  control  of 
business  firms  make  explicit  use  of  the  notion  of  maximum 
profit.  These  writings,  though  often  not  too  clear  in  presen¬ 
tation  and  not  developed  in  detail,  do  provide,  in  essence,  a 
satisfactory  solution  for  the  case  when  all  variables  not 
controlled  by  the  firm  are  known  in  advance  with  certainty. 

1 :D  The  natural  extension  to  the  case  when  at  least  some 
of  the  non— controlled  variables  are  random  variables,  is  to 
maximize  the  e-'.pected  (actuarial,  average)  value  of  profit,  or 
of  utility.  This  presupposes  the  explicit  use  of  the  probability 
distribution  of  demand  (or,  more  generally,  the  joint  probability 
distribution  of  demand,  pipeline  time,  purchase  price,  and  other 
non— controlled  variables).  Tliis  aistribution  either  can  be 
known  in  advance,  or  may  have  to  be  estimated  with  the  necessary 
precision  as  the  data  on  demana,  etc.,  are  being  accumulated. 

1  :E  The  I'andora  nature  of  the  non— controlled  vai’iables  is 
recognized  implicitly  in  the  customary  provision  for  "cushion" 
or  "safety— margin"  stocks.  Hov/ever,  we  have  not  been  able  to 
find  in  the  business  literature  an  explicit  rule  of  determining 
"cushion  stocks"  that  would  maximize  expected  profit  (or  minimize 
expected  loss),  given  the  relevant  probability  distribution. 
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1 :F  Explicit  use  of  a  (Poisson)  distribution  of  demand 
was  made,  in  a  pathbreaking  manner,  by  Thornton  C.  Fry  [6]. 

This  was  later  developed  by  Churchill  Eisenhart  [3]  and 
apparently  also  applied  by  R.  H.  Wilson  [10].  In  this  approach, 
the  recommended  rules  of  action  are  derived  not  by  prescribing 
that  the  expected  net  utility  be  a  maximum  but  by  prescribing 
that  the  probability  of  stock  depletion  should  have  a  certain 
level.  This  is  analogous  to  the  fixing  of  a  "significance  level" 
by  a  hypotheses— testing  statistician  of  the  pre— Wald  era,  (In 
various  writings  since  1939>  ^vbruhain  '..'aid  has  suggested  choosing 
statistical  test— proceuures  so  as  to  minimize  the  expected  loss 
to  the  policymaker, )  The  choice  of  the  suitable  probability  of 
stock  depletion  must  ultimately  depend  on  utility  considerations, 
albeit  in  a  hidden  fashion.  We  shall  try  to  make  such  considera¬ 
tions  explicit,  (See  also  }:£  below.) 

1 :G  In  "non-profit"  organizations  utilities  other -than 

money  must  be  used.  ns  for  uncertainty,  it  is  of  course  always 

■present  in  non-profit  no  less  than  in  commercial  organizations. 

■Various  organizations  have  their  ow^n  rules  for  taking  care  of 

uncertainty.  However,  it  is  not  always  obvious  how  these  I'ules 

( 

v/ere  uerived  from  considerations  of  utility  (e.g.,  the  loss  caused 
by  the  inability  of  a  supplying  agency  to  meet  an -urgent  require¬ 
ment)  and  from  considerations  of  probability  (e.g.,  the 
probability  that  a  requirement  will  not  be  met). 
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1 :H  To  sum  up  our  ovn  approach:  the  net  utility  to  any 

» 

policymaker  is,  in  general,  a  random  variable  depending  on 
certain  conditions  (i.e.,  on  variables  or  on  relations  between 
variables).  Some  of  these  conditions  he  can  control,  others  he 
cannot.  The  former  are  policy  means  (strategies).  The  non— 
controlled  conditions  are,  in  general,  defined  by  a  joint 
probability  distribution  of  certain  variables.  Rational  policy 
consists  in  fixing  the  controlled  conditions  so  as  to  maximize 
the  expected  value  of  net  utility,  given  tlie  probability  distri¬ 
bution  of  non— controlled  conaitions.  '..'hen  this  probability 
distriuution  aegenerates  into  a  set  of  non— random  vai-iables  we 
iiave  the  case  of  "certainty."  In  this  limiting  case,  net  utility 
itself  is  a  non— random  variable,  to  be  maximized  by  the  policy¬ 
maker  . 

1  ;I  as  already  i.ientioned  (iii  1  :B)  ,  at  most  one  of  the 
non— controlled  conditions  will  be  regarded  in  the  present  paper 
as  a  randora  one:  the  rate  of  demand  for  the  policymaker’s 
product.  Other  non— controlled  conditions  will  be  regarded  as 
constants,  or  as  relations  with  constant  parameters:  the  relation 
between  storage  cost  and  the  size  of  industry;  the  relation 
between  purchasing  price  and  the  size  of  order  ("supply  function") 
and  the  cost  of  making  an  order. 

rtS  to  controlled  conditions,  we  shall  assume  that  the  policy¬ 
maker  can  control  only  the  size  of  the  orders  he  maxes.  This 
eliminates,  for  exasiple,  such  policy  means  as  the  fixing  of  the 
selling  price,  or  the  use  of  advertising,  to  influence  demand;  and 
any  bargaining  with  buyer(s)  or  competitor ( s  )  . 
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although  it  would  be  interesting  and  useful  to  broaden  the 
problem  in  the  various  directions  just  indicated,  we  believe  our 
specialized  formulation  is  a  workable  lirst  approximation.  By 
regarding  the  order  size  as  the  only  controlled  condition,  and 
the  aemand  as  the  only  random  non— controlled  condition,  we  do 
take  account  of  most  of  the  major  questions  that  have  actually 
arisen  in  the  practice  of  business  and  nonprofit  organizations. 

1:J  bection  2  of  the  present  paper  will  give  the  essentials 
of  the  optimal  stock  determination  under  conditions  of  certainty. 
The  remaining  sections  will  treat  the  uncertainty  case,  considering 
demand  as  the  only  random  variable.  Section  3  discusses  a  static 
model.  Section  4  formulates  the  mathematical  problem  for  a 
simplified  dynamic  model,  for  which  Section  5  outlines  a  method 
of  solution.  Section  6  contains  examples:  solutions  for  the 
simplified  dynamic  model  are  given,  assuming  specific  distributions 
of  demand.  Possible  extensions  of  this  model  are  briefly  defined 
in  Section  7» 


Before  formulating  tlie  problem,  a  study  v/as  iuaae  of  the  existing 
business  literature  on  inventory  control,  using  freely  the 
comprehensive  bibliography  jjOj  that  v;as  compiled  by  T.  H.  'whitin 
ana  Louise  B.  Haacx  for  the  Logistics  iLesearch  Project  of  the 
Office  of  Naval  hesearch  at  the  George  v.ashington  University. 
Some- of  the  aoove  suggestions,  broadening  the  problem  so  as  to 
embrace  the  models  of  perfect  and  impei'fect  mai-Kets  as  discussed 
in  the  academic  economic  theory,  are  due  to  Mr.  karkowitz, 

Cowles  Commission  for  Research  in  Economics. 


! 
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2 .  The  Case  of  Certainty 

,2: A  Let  x  be  the  knovjn  constant  rate  of  demand  for  the 
product  of  the  organization,  per  unit  of  time.  Let  the  gross 
utility  (i.e.,  utility  before  oeducting  cost)  obtained  by  the 
organization  through  satisfying  this  demand,  be 

ax  +  Uq  . 

We  can  assume  Sq  =  0  (this  will  not  influence  the  solution  of 
our  problem).  In  this  case,  if  the  organization  is  a  commercial 
firm,  §  is  the  selling  price;  Otherwise  §  is  .the  value  to  the 
organization  , of  an  operation  of  some  kind.  .  In  general,  g  is 
a  function  of  x;  but  it  will  be  sufficient,  for  our  purposes, 
to  assume  g  constant.  Denote  by  b  the  purchasing  price  (in 
money  units  or  utility  units)  of  one  unit.  Because  of  the 
possible  econoiny  of  large  scale  orders,  b  is  a  non— increasing 
function  of  the  amount  oraered:  b  =  b(S),  b*  <0,  assuming 
differentiability.  Let  K  be  the  cost  of  handling  an  order, 
regardless  of  its  size.  Let  z  be  the  stock,  and  let  the  cost 
of  carrying  it  over  one  unit  of  time  be 

const.  +  2cz  , 

the  constant  part  being  the  overhead  cost  of  storage.  In  general, 
the  coefficient  c  may  be  a  function  of  z,  but  it  will  suffice 
here  to  assume  c  constant. 

..2:B  j^ssume ,  to  begin  with,  that  orders  are  fulfilled 
immediately.  Then  orders  must  be  made  whenever  the  stock  reaches 


A. 
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zero:  to  order  earlier  would  cause  unnecessary  storage  cost, 

and  to  order  later  would  cause  unsatisfied  demand.  The  amount 
ordered  must  equal  the  maximum  stock,  S.  The  average  level  of 
stock  vail  be  S/2;  see  Figure  1,  v/here  6  is  the  time  elapsing 


between  aiaKing  an  order  and  having  the  stock  completely  exliausted. 
Clearly  S  ( or  b )  is  controlled  by  the  policymaker,  and 

(2.1 )  s  =  xe  . 

We  shall  first  assume  that  b  can  take  all  real  positive  values 
(but  see  2:£J.  The  problem  is  to  choose  the  optimal  S  and  0. 
Consider  a  time  interval  of  0  units,  beginning  v/ith  the  ordering 
of  S  units  of  goods  and  ending  when  the  stock  is  exhausted.  The 
total  utility  derived  during  this  period,  apart  from  a  constant 
overhead  cost  of  storage ,  is 

aS  -  bS  -  2ce(|)  -  K  , 

*We  neglect  the  fact  that  a  part  of  the  overhead  cost  of  storage  — 
the  interest  and  the  amortization  charge  on  stored  goods  —  depend 
on  the  purchasing  price  b(3) ;  the  required  modification  is  simple 


I 
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or,  per  unit  of  time,  by  (2.1), 


(2.2) 


ax  —  bx  —  cS  —  (xK/S)i. 


Suppose  the  future  time  over  which  utility  is  maximized  —  the 
’’horizon*'  —  is  either  infinite  or  is  long  enough  to  be  considered, 
without  great  er-ror,  as  a  sequence  of  an  integral  number  of 
periods,  of  «  units  each,  vath  initial  stocks  at  zero.  Then 
the  maximizing  of  utility  ovei-  the  "horizon"  with  respect  to  S 
is  equivalent  to  the  maximizing  of  (2.2),  or  (since  §  is 
independent  of  S)  to  minimizing  the  cost 

(2.3)  C  =  xb(S)  +  cS  +  (xK/S)  . 

Hence  the  optimal  value  of  the  amount  ordered,  S  ■  S* ,  must 
satisfy  the  eouation 

(2.4)  xb’(S«)  +  c  =  xK/(S>!')^  , 

and  the  inequality 

(2.5)  b"(S«)  >  -2[c  +  xb '  (  S«  )] /S^  . 


2;C  V/e  shall  assume  the  purchase 
function)  b(S)  linear,  so  that  b"  =  0 

(2.6)  b(S)=bQ-b^S 

with  bi  >  0.  Then  by  (2.1 ) ,  (2.3 ) 


price  function 
identically  and 

(  say) 


(supply 


(2.7) 


G  =  bQX  +  x(c  -  b,x)e  +  K/e  =  C(e), 


say . 
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The  optimal  re— ordering  period  *  0*  is 

(2.8)  e*  =  f^K7x(c  -  b^x)  . 

Note  that  for  to  be  real  and  finite,  the  following  constraint 
upon  the  demand,  and  upon  the  conditions  of  storing  and  purchasing, 
must  be  satisfied: 


0  <  b^  <  c/x  , 

The  minimum  cost,  C* ,  is  by  (2.7),  (2,8) 

(2.9)  “  C(e’>=)  «  bQX  +  2//Kd  , 
where 

(2.10)  d  =  x(c  —  b^x)  >  0, 

and  the  positive  root  is  taken.  The  optimal  size  of  an  order  is 
by  (2.8),  (2.1), 

(2.11)  S’i'  =  f/Kx/ (  c  —  b^x)  . 

Hence,  as  should  be  expected,  the  optimal  order  size,  and  thei’efore 
the  optimal  oroering  interval  is  the  larger,  the  larger  the  cost 
K  of  handling  an  order,  the  smaller  the  unit  storage  cost  c  and  the 
larger  the  effect  of  the  size  of  order  upon  the  unit  price. 

We  believe  this  is,  in  essence,  the  solution  advanced  by 
R.  H.  Wilson  [10],  formerly  of  the  Bell  Telephone  Company;  and  also 
by  other  writers ;  see  [1]- 
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2;D  If  v;e  now  introduce  a  constant  ’’pipeline  time,”  T>  0, 
elapsing  between  order  and  delivery,  this  will  not  affect  S*  or 
©*,  but  the  time  of  issuing  the  order  vdll  be  shifted  T  time 
units  ahead.  The  order  will  be  issued  when  the  stock  is  reduced, 
not  to  zero,  but  to  xT  units. 

2:E  The  policymaker  may  not  have  full  control  of  the  length 
of  the  time  interval  between  any  two  successive  orders.  Trans¬ 
portation  schedules  or  considerations  of  administrative  convenience 
may  be  such  as  to  make  ordering  impossible  at  intervals  of  length 
other  than,  say,  6  /  For  example,  0  may  be  one  business 

day  or  week;  or  0°  may  be  the  period  between  two  visits  of  a  mail- 

boat  to  an  island  depot.  Orders  of  positive  size  may  be  spaced 

0 

only  at  intervals  of  length  0  *  m6  ,  where  m  is  a  positive  integer. 

We  have  to  find  the  value  m  *  m'  that  will  minimize  the  cost  (2.3). 
The  corresponding  optimal  length  of  interval  between  tv.'o  non— zero 
orders  vdll  be  denoted  by  0',  and  the  optimal  order  size  by  S’, 

The  optimal  set  (m’ ,  0’,  S’)  is  unicue  since,  as  previously 
indicated  in  2:B,  it  can  never  pay  to  possess  a  non— zero  stock  at 
a  time  when  reordering  takes  place  (or,  more  generally,  T  time 
units  after  the  reordering,  T  >  0;  see  2:D).  Hence,  at  a  reordering 
time,  the  situation  is  always  the  same  as  that  at  the  beginning 
of  the  entire  process.  Therefore,  there  is  no  possibility  of 
gaining  by  having  a  variable  0’  or  S’. 

To  find  the  optimal  values  for  m,  0,  S,  note  that  (2.7)  is 
a  continuous  function  of  0,  v.ith  a  unique  minimum  at  @  =  9*  when 
0  is  not  restricted. 
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Suppose  first  that  the  permissible  interval  length  6°  >  6* , 

and  therefore  the  interval  length  between  the  successive  non— zero 

orders,  6  “  Then  (2.7)  is  smallest  when  m  •  m’  *  1 .  ^ 

o  0 

Hence  0’  *0  ,  S’  *  x0  .  For  example,  if  S’**  =  14  days  but  orders 

can  be  placed  only  every  9®  =  30  days,  then  optimal  reordering 

period  9’  *=30  days  (not  60  or  90,  etc.).  Suppose  next  that 

0*^  <  6*,  and  that  the  ratio  n  *  6*/©°  is  an  integer,  n  >  1.  Then 

obviously  (2.3)  is  minimized  at  0’  *  0*  *  n0° ;  that  is,  m'  *=  n, 

S'  »=  S’*'.  (For  example,  if  0=*=  =  14,  0°  =  7  days,  then  orders  will 

be  issued  every  6*  *  I4  days.)  Finally,  if  0°  <  0*  but  the  ratio 

n  is  not  an  integer,  consider  the  integer  n,  n<n<n+1.  Then 

m’  =norn+1,  i.e.,  the  optimal  length,  6’,  of  the  interval 

between  two  successive  non— zero  orders  will  be  either  n©’*'  or 

(n+l)©"**,  whichever  leads  to  a  smaller  cost  (2.3)«  (For  example, 

if  0’!'  “  11,  0°  -  7,  then  0’  =  7  or  14.) 

2:F  As  an  important  generalization  of  the  case  of  fixed 

intervals  between  (positive  or  zero)  successive  orders,  one  v:ould 

have  to  consider  the  case  when  orders  can  be  made  at  any  time, 

0 

but  at  varying  hanaling  cost  K.  Let  K  *=  K  for  the  instants 
0,  0°,  20°,  ’**,  and  K  =  >  K°  for  all  other  instants.  (This 

degenerates  into  the  case  of  sub— section  2:E  when  is  infinite^ 

Let  us  refer  to  periods  which  are  multiples  of  0°  as 
scheduled  periods,  the  others  as  non— scheduled  periods.  If  we 
consider  only  the  latter,  then  by  (2.9),  the  minimum  attainable 
cost  is  LqX  +  2  .  For  scheduled  periods  the  cost,  by  (2.7), 

(2.10),  is  bgX  +  d©  +  (K°/0).  The  range  of  values  of  0  for  which 
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the  last  expression  is  not  greater  than  the  minimum  cost  attainable 
with  a  non— scheduled  period  is,  then, 

de  +  (K°/e)  <  2  , 


or. 


de  -  2 


'K'^d  e 


0 

K  <  0, 


or, 

_  1  _  1_ 

(2.12)  d  <  y  <  d  . 

Therefore,  a  scheduled  period  will  be  used  if  a  multiple  of  0° 
falls  in  the  interval  (2.12);  otherwise,  the  optimal  non— scheduled 
period,  ^K^/d ,  is  used.  Replacing  0  by  n6°  in  (2.12)  and  dividing 
through  by  0*^  yields  the  following  condition  for  using  a  scheduled 
period:  The  interval  from 

(2.13)  d  ^  -  K°)/0°  to  d  ^  (t"  +  Vk'*’  “  K°) / 6° 

should  contain  a  positive  integer. 

Clearly,  a  sufficient  condition  is  that  the  interval  (2.13) 
contain  the  nuinbei-  1  ,  white  a  necessary  condition  is  that  the 
upper  limit  should  be  at  least  1 .  Suppose  the  upper  limit  is  at 
least  1  and  at  the  same  time  at  least  twice  the  lower  limit.  Then 
either  1  belongs  to  the  interval  (2.13),  in  which  case  a  scheduled 
period  should  be  used,  or  1  lies  below  the  lower  limit.  Let  n  be 
the  largest  integer  below'  the'.low'er  limit  of  (2.13);  then  the 
integer  2n  lies  below  the  upper  limit  and  above  the  lower,  so  that 
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again  the  interval  (2.13)  contains  a  positive  integer. 

The  condition  that  the  upper  limit  be  at  least  twice  the 
lower  is  that 

2  (Vk^  -  K°)  <  , 

which  is  equivalent  to  >  9/8,  If 

1 

(2.14)  kVk°  >  9/8  and  //P  +  i^K*  -  K°  >  e°d^  , 

then  a  scheduled  interval  should  be  used. 

(2.14)  is  a  sufficient  condition  while  (2.13)  is  both 
necessary  and  sufficient. 

2:G  In  this  and  the  next  two  sub— sections ,  we  conclude  the 
discussion  of  the  case  of  a  certainty  by  remarks  on  the  problem 
of  ’’aggregation.”  Let  there  be  several  commodities,  numbered 
i  =  1 ,  2,  *•*,  and  characterized  by,  generally,  different  storage 
cost  coefficients  c^  and  different  purchase  price  functions  b^. 

Let  us  first  assume  that  the  cost,  K,  of  handling  an  order  does 
not  depend  on  the  size  or  composition  of  the  order.  The  problem 
is  to  find  optimal  ordering  intervals  for  the  several  commodities, 
possibly  arranging  the  coraraodities  into  subsets  so  that  all 
members  of  a  subset  are  ordered  simultaneously,  ^ 

Consider  the  set  of  the  first  q  commodities.  Assuming  a 
linear  purchase  price  function  for  each  commodity  and  applying 
the  notations  of  sub— section  2;C,  with  a  commodity  subscript  i 

where  necessary,  compare  the ^following  two  costs  (per  unit  of 
time):  1 )  the  minimum  cost,  ct  of  ordering,  buying  and 


16  November  1950 
Page  14,  P-189 


storing  the  q  commodities,  when  each  commodity  is  reordered  at 
intervals  of  length  0^  chosen  so  as  to  minimize  C ;  2)  the 

minimum  cost  C  of  ordering,  buying  and  storing  the  commodities 
when  all  are  ordered  at  the  same  time  at  intervals  of  length  9. 
V;e  have  by  (2.3),  (2.9),  (2.10), 

(2.15)  6*  -  VK/d,  ,  dj^  -  >0,  i  - 

(2.16)  Z  Ct  -  Z  *  2  . 


where  the  summation  is  from  1  to  q,  and  every  root  is  positive. 
On  the  other  hand,  9  »  0  minimizes  the  expression 


analogous  to  the  right-hand  side  of  (2.7),  v/ith  21  replacing  d 
Hence 


(2.17) 


(2.18) 


C  »  Z  boi^l 


9 


the  root  being  positive.  is  always  smaller  than  21  »  since 

the  scuare  of  21  ©J^^ceeds  the  square  of  Kd^^  by 

2  21  X  K  f  j, 

which. is  positive.  Thus,  if  K  does  not  depend  on  the  composition 
of  the  order,  it  is  preferable  to  order  all  q  commodities  of  the 
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considered  subset  at  the  same  time,  provided  the  common  period 
length  is  determined  as  in  (2.17).  This  is  true  for  any  q,  and 
therefore  also  for  the  set  of  all  commodities. 

2:H  The  situation  becomes  different  if  the  cost  of  handling 
the  order  depends  on  its  composition.  Let,  for  example,  K(i)  be 
the  cost  of  handling  an  order  (of  any  size)  for  the  i^  commodity, 
K(i,  j)  the  cost  of  handling  an  order  for  any  quantities  of 
commodities  i  and  j,  etc.  xiiven  if  we  still  maintain  the  assumption 
t'hat^JC(l)  *  K(2)  *  •••  “  K,  the  advantage  of  aggregation  may 
disappear  if  we  ao  not  maintain  any  more  that,  for  the  given  set 
of  q  com.odities,  also  K  =  K(l,  2,  •••,  q) .  (For  example,  the 
handling  of  an  order  requiring  the  services  of  an  aircraft  expert 
as  well  as  a  canned  food  specialist  may  be  much  more  expensive 

I 

than  the  ordering  of  these  commodities  separately.)  V/e  have,  then, 
in  fact,  to  compare  ^  with  v^K(  1  ,  •••,  q) 

Kfe  with  K(  1  ,  2,  q)  ^  d^  .  iVggregation  is  advantageous 

if  the  right-hand  expression  is  smaller  than  the  corresponding  left- 
hand  one,  i.e.,  when 

(2.1^)  I  < 


In  particular,  j f  d^ 


=  d  for  all  i 


j,  the  above  condition 


becomes 
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i.e.,  it  is  required  that  the  cost  of  ordering  the  q  commodities 
separately  should  be  less  than  q  times  the  cost  of  ordering  them 
jointly.  In  the  general  case  d^  ^  d^,  1,  j  =  1,  •••,  q,  the 

condition  (2.l8)  can  be  interpreted  as  follows.  Define  e^  *  V37  • 
Then 

.  •  ( 

(2.19)  d.  ^  ef  “  q((/  +  e^)  , 

i  1  i  1  e 

where  is  the  standard  deviation  of  the  e’s  and  e  their  mean. 

Also , 

(2.20)  (^Vd-)"  -  ej'  -  q"  I"  . 


From  (2.18),  (<^.19)  and  (2.20),  the  condition  that  aggregation  be 
advantageous  is  that 


(2.21  ) 


2 


< 


q(cr: 


e  ) 


+  1 


where  V  “  <r  /  e  is  the  coefficient  of  variation  of  the  e*s.  The 
e  ' 

2 

expression  1  /  (V  +  1  )  indicates  the  dissimilarity  between  the  q 
considered'  commodities  v/ith  respect  to  their  storage  cost  and 
purchase  conditions.  Condition  (2.21  )  states  that  aggregation  is 
advantageous  if  the  joint  cost  of  ordering  the  set  of  q  commodities, 
multiplied  by  a  " cos t— dissimilarity  index,"  is  less  than  q  times 
the  cost  of  ordering  any  one  commodity  separately. 
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2:1  A  problem  analogous  to  that  of  optimal  aggregation  of 

commodities  into  groups,  is  that  of  the  optimal  number  of  storage 

depots;  or  more  generally,  the  optimal  (bivariate)  distribution 

of  orders  among  the  givers  of  orders  (depots)  and  the  receivers 

of  orders  (manufacturers  and  transporters).  This  presupposes  the 

t  It 

knowledge  of  tlie  storage  cost  ~  ~  say  —  —  of  the  h^  order— giver 

and  the  knowledge  of  the  big— lot  price  reduction - b^j^  say  —  — 

of  the  order— receiver ;  these  result  in  a  joint  frequency 


distribution  of  a  parameter  d^^j^ , 


analogous 


to  the  parameter  d^  in 


(2.15)*  Some  fundamentals  of  this  problem,  given  certain  parameters 


of  utility  and  cost,  were  treated  by  Tompkins  in  [  B  ]■ 


I 
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3 •  A  Static  Model  with  Uncertainty 

3;ii  Suppose  an  organization  wants  to  choose  the  level  z  >  0 
that  the  stock  of  a  certain  commodity  should  have  at  the  beginning 
of  a  given  period,  in  order  to  provide  for  the  demand  (requirements) 
that  will  occur  during  that  period.  We  shall  choose  the  time  unit 
to  be  e^-ual  to  the  length  of  this  period,  and  use  the  notations  of 
Section  2.  Thus  x  >  0  will  denote  the  demand  during  the  period. 
However,  x  will  now  be  regarded  as  a  random  variable.  vVe  shall 
suppose  that  the  organization  knows  the  cumulative  distribution  of 
demand  F(x)  (but  see  7tD  below).  The  utility,  to  the  organization, 
of  delivering  ^  units  of  commodity  will  be 

(3*1)  constant ) . 

The  delivery  during  the  period  is  a  random  variable:  ^  equals  x  or 
z,  whicliever  is  smaller.  Hence  the  expected  utility  derived  from 
satisfied  demand  is 

{}  .2)  a  z  ^1  —  F  (  z  )3  +  a  j  x  dF  ( x )  +  aQ  . 

We  shall  assume  that  the  amount  to  be  spent  in  purchasing  ^  units  is 
(3.3)  (^(bQ  -  b^  I^)  +  K  ;  h^>0,  b^  >  0  ; 

so  that  as  in  Section  2,  the  purchase  price  is  either  constant  or 
linearly  decreasing  with  the  amount  purchased.  As  before,  the  cost 
of  handling  an  order  is  denoted  by  K  but  this  term  will  not  play  any 
further  role  in  the  static  model.  However,  we  assume  here  that  the 
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whole  stock  z  is  to  be  purchased  (so  that  always  *  z),  and  that 
no  utility  is  derived  from  satisfying  demand  after  the  period »s 
end.  Finally,  the  cost  of  carrying  over  our  period  the  stock  which 
has  level  z  at  the  beginning  of  the  period,  will  be  assumed  to  be 

(3»4)  const.  +  cz  . 


Then,  apart  from  a  ’’depletion  penalty”  which  we  shall  introduce 
in  3:B,  the  net  expected  loss  (the  negative  of  net  expected  utility) 
is 


(3.5) 


const .  +  z  (  c  +  b, 


0 


—  b^  z) 


n  ^ 

az  [^1  —  F(  z  )]]  —  a  x  dF(x) 


3:B  V.'e  now  define  TT  ,  the  ’’depletion  penalty,”  as  follows: 
if  X  <  z,  there  is  no  unsatisfied  demand,  and  TT  “0;  but  if  x  >  z, 
the  organization  would  be  willing  to  pay  an  amount  "fT  >  0  to  satisfy 
the  excess,  x  —  z,  of  demand  over  available  stock. 

We  assxime  the  ( enalty  function  as  given.  The  organization  — 
whethei’  commercial  or  noncommercial  —  has  a  general  idea  of  the  value 
it  would  attach  to  the  damage  that  would  be  caused  by  the  non¬ 
availability  of  an  item;  it  knows  the  cost  and  the  poorer  performance 
of  emergency  substitutes.  The  penalty  for  depleted  stocks  may  be 
very  high:  ”a  horse,  a  horse,  my  kingdom  for  a  horse,”  cried 
defeated  Richard  III. 

3:C  Note  that,  in  the  case  of  a  commercial  enterprise,  an 
independent  penalty  function  TT  =  Tr(x  —  z)  need  not  be  introduced. 

It  can  be  replaced  by  consi'derations  on  ’’losing  custom,”  as  in  the 
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following  model.  Let  F.  be  a  Poisson  distribution  of  demand  for 
the  period  (t,  t+  1).  Its  mean,  '  is  proportional  to  tHie 

probability  that  a  member  of  a  large  but  finite  reservoir  of 
customers  will  want  to  buy  during  that  period,  equals 

if  the  demand  during  (t— 1,  t)  was  satisfied.  But  if  that  demand 
was  in  excess  of  the  then  available  stock,  is  smaller  than 

by  an  amount  proportional  to  the  unsatisfied  demand,  as  some 
of  the  disappointed  custom'ers  w'ill  drop  out  of  the  market.  The 
problem  is  to  maximize  total  expected  utility  over  a  sequence  of 
periods  (0,  1),  (1,  2),  ***,  if  the  initial  distribution  Fq  is 
given.  Such  a  dynamic  model  would  be  more  complicated  than  the 
one  we  are  going  to  treat  in  Sections  L— 7* 

3:D  We  shall  assume 

TT  A  +  B(x  —  z),  if  X  >  z, 

TT  ■  0  otherwise, 

where  a,  B  are  non— negative  constants,  not  both  zero.  Then  TT  is 
a  random  variable,  with  expectation 

(3.6)  (a  -  Bz)  [1  -  F(z)]  +  B 

Accordingly,  the  expected  net  loss,  taking  account  of  expected 
penalty,  is  the  sum  of  the  expressions  (3*5)  ^^i^d  (3.6)  and  equals, 
apart  from  a  constant, 

(3.7) .  z(c  +  bQ-b^z)  +  a[i  -F(z)]  -  (B  +  a)z  [1-  F(z)]  -  (B+  a)^  x  dF(x) 


00 


X  dF(x) 


=  L(z)  , 
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say.  The  stock  level  z  *  z"**  is  optimal  if  L(z*)  <  L(z)  for  every 
z.  Suppose  the  distribution  function  F(x)  possesses  a  differentiable 
density  function  f(x)  s.  dF(x)/dx,  If  the  absolute  minimum  of  L  is 
not  at  z  ■  0 ,  it  will  be  at  some  point  satisfying  the  relations 

dL(z’*')/dz  *  Q,  d^L(z’^)/dz^  >  0, 
which  imply  that 

(  3  .^ )  +  bQ  —  2b^  —  (B  +  a )  []l  —  F(  z”** )]  =  0  , 

(3.9)  -2h^  -iif»(z’^)  +  (B+a)f(z’^)  >0. 

3:E  In  the  economist's  language,  the  first  bracketed  term  in 
(3«b)  is  the  "marginal  cost"  (of  buying  and  carrying  an  additional 
unit  in  stock);  the  remaining  two  terms  yield  the  "marginal  expected 
utility . " 

It  is  seen  from  {3.c)  that  the  optimal  stock  z  is  determined 
by  the  following  "physical  data,"  or  "non— controlled  parameters": 

1)  the  demand  distribution  function  F(:jc);  2)  certain  utility  and 

cost  parameters;  (c  +  bQ) ,  b^ ,  A,  and  (B  +  a).  If,  in  particular, 
b^  “0  (i.e.,  the  economy  of  big— lot  purchases  is  negligible), 
these  parameters  reduce  to  two:  a/(c  +  b^ )  and  (B  +  a)/(c  +  bQ). 

To  simplify  further,  for  the  sake  of  illustration,  suppose  also 
that  B  *  a  =  0:  that  is,  the  penalty  is  either  zero  or  a,  independent 
of  the  size  of  the  unsatisfied  demand;  and  utility  derived  from  the 
functioning  of  the  organization  does  not  depend  on  the  amounts 
delivered.  Then  (3.b)>  (3.9)  become 
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(3.10)  f(z*)  -  (c  +  bQ)/A;  f»(z*)  <  0  . 

A  graphical  solution  for  this  case  is  shovm  in  Figure  2.  (Note  that 
f’(z'*')  <0  but  f*(z')  >0;  z’*'  is  the  best  stock  level,  but  z'  is  not.) 


3;F  In  scane  previous  literature  (Ref.  [[6,  3  ])>  the  decision 
on  inventories  was  related,  not  to  utility  and  cost  considerations, 
but  to  a  preassigned  probability  (l  —  F(z))  that  demand  will  not 
exceed  stock.  The  choice  of  the  probability  level  1  —  F(z)  depends, 
of  course,  on  some  implicit  evaluations  of  the  damage  that  would  be 
incurred  if  one  would  be  unable  to  satisfy  demand.  In  the  present 
paper,  these  evaluations  are  made  explicit.  On  the  other  hand, 
since  the  value  of  the  parameters  such  as  n ,  B,  a  can  be  estimated 
only  in  a  broad  way  (at  least  outside  of  a  purely  commercial 
organization,  where  utility  =  dollar  profit,  and  where  models  such 
as  that  of  3:C  can  be  developed),  it  is  a  welcome  support  of  one’s 
judgment,  to  checK  these  estimates  by  referring  to  the  corresponding 
level  of  probability  for  stock  depletion.  For  example,  if  the 
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distribution  on  Figure  1  were  approximately  normal,  then  to  assume 
that  penalty  A  is  100  times  the  marginal  cost  c  +  bg  would  be 
equivalent  to  prescribing  that  the  shaded  area  measuring  the 
depletion  probability  should  be  0.3%;  to  assume  that  a  =  10 
(c  +  bQ )  would  be  equivalent  to  making  depletion  probability  *  5%i 
etc . 

3:0  In  the  more  general  case,  when  B  +  a  >  0  (but  still 
b^  =  0) ,  a  given  optimal  stock  level  z  ,  and  consequently  a  given 
probability  of  depletion  1  —  F{z  )  is  consistent  with  a  continuous 
set  of  values  of  the  pair  of  parameters:  A/{c  +  bg)  =  A*, 

(B  +  a)/(c  +  bg)  =  B* ,  such  as  would  satisfy  the  linear  equation 
(3.3) .  For  example,  if  F(x)  is  normal,  then  an  optimal  stock 
exceeding  the  average  demand  by  two  standard  deviations  of  demand 
(and,  consecuently ,  a  depletion  probability  of  2.3%),  will  be 
required  by  any  pair  of  values  of  A’ ,  B’  lying  on  the  straight  line 
intersecting  the  A*  —  axis  at  13  ^md  intersecting  the  B’  —  axis 
at  44;  while  an  optimal  stock  exceeding  the  average  demand  by  three 
standara  deviations  (and,  consecuently,  a  depletion  probability  of 
0.1%),  will  correspond  to  a  straight  line  intersecting  those  axes 
at  223  and  7A0 ,  respectively.  Thus  a  set  of  contour  lines  helps  to 
choose  an  interval  of  optimal  stock  values  consistent  with  a  given 
region  of  plausible  values  of  utility— and— penalty  parameters. 
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4»  A  Dynamic  Model  of  Uncertainty;  Problem 

4:A  The  model  described  in  Section  3  roay  be  called  a  "static” 
one.  We  shall  now  present  a  "dynamic"  one.  In  this  model,  the 
commodity  can  be  ordered,  and  reordered,  at  discrete  instants 
»  ®0’  ***»  ***»  ®0  ^  fixed  constant  (but  see  7-B), 

V/e  can  therefore  use  Sq  as  a  time  unit.  Let  be  the  demand  over 
the  interval  (t,  t+  1).  Assume  the  probability  distribution  of 
demand  F(x)  to  be  independent  of  t.  Denote  by  y^  the  stocK  available 
at  instant  t,  not  including  any  replenishment  that  may  arrive  at 
this  instant.  Denote  by  the  stock  at  t  including  the  replenishment. 
Denote  by  o^  the  amount  ordered  at  time  t.  Let  the  time  between  the 
ordering  ana  the  receiving  of  goods  ("pipeline  time")  be  T.  Then, 


(4.1  ) 


yt  “  -  ^t-1» 


t  “  1 ,  2, 


( 4 . 2 ) 


^t+r  *  yt+r  °t  > 


t  =  0 ,  1  ,  •  •  • 


In  general,  TT  is  a  non— negative  random  variable.  We  shall,  however, 
assume  T  =  0  to  simplify  the  analysis  at  this  stage.  Then  (4.2) 
becomes 


(4.3) 


=^t  =  yt  "  °t  • 


Choose  two  numbers  S  and  s,  S  >  s  >  0,  and  let  them  define  the  following 
rule  of  action: 


If  y^  >  s,  o^  =  0  (and  hence  z^  “  yt^’ 
if  y^  <  s,  o^  =  S  —  y^  (and  hence  z^  =  S) . 


(4.4) 
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Figure  3  shows  the  sort  of  curve  that  might  be  obtained  for  stock 
level  as  a  function  of  time  if  such  a'  rule  is  adopted. 


Time 


Figure  3 


Figure  4 
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4:B  We  shall  assume  (as  we  have  done  in  Sections  2  and  3)  that 
the  cost  of  handling  an  order  does  not  depend  on  the  amount  ordered. 

Let  this  cost  be  K,  a  constant.  Let  the  depletion  penalty  be  A,  a 
constant:  compare  (3.4),  with  B  *  0.  Let  the  variable  cost  of 

carrying  a  stock  during  a  unit  of  time  be  c,  as  in  (3.4)*  Assume 
the  purchasing  price  per  unit  of  commodity  to  be  independent  of  the 
amount  bought,  and  equal  to  the  marginal  utility  of  one  unit  (i.e., 
in  the  notation  of  sub— section  3: A,  b^  *  0,  bQ  ■  a).  That  is,  the 
utility  of  operations  of  the  agency,  in  excess  of  the  expenses  paid 
for  these  operations,  is  assumed  constant,  apart  from  the  cost  of 
storage  and  of  handling  orders.  In  the  notations  of  3: A,  this 
constant  is  Sq  ,  while  K  and  c  denote,  respectively,  the  cost  of 
handling  an  order  (of  any  size)  and  the  marginal  cost  of  storage. 

Our  assumption  is  an  admissible  approximation  in  the  case  of  some 
non-profit  agencies.  It  would  be  certainly  both  more  general  and 
more  realistic  to  make  the  marginal  utility  of  an  operation  differ 
from  its  purchasing  price  as  was  the  case  in  our  static  model.  But 
this  will  recuire  further  .mathematical  work  (see  7:A). 

4:C  If  yQ  is  given  and  values  S  and  s  are  chosen,  the  subsequent 
values  form  a  random  process  which  is  "Markovian";  see  Feller  [^5l], 
Chapter  15*  That  is,  the  probability  distribution  of  y^+.|  ,  given  the 
value  of  y^ ,  is  independent  of  ,  ***,  Fq*  During  the  period 

(t,  t+l)  a  certain  loss  will  be  incurred  whose  conditional  expectation, 
for  a  fixed  value  of  y^ ,  we  denote  by  /(y^).  Under  the  simplifying 
assumptions  of  sub— section  4:B, 
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(4.5) 


^  LcS  +  a[1  -  F(3)]  + 


for  >  s, 

K  for  <  s 


Thus  the  function  Aiy^)  involves  S  and  s  as  parameters  and  is 
constant  for  y^  <  s.  Note  that 


(4.6) 


i(0)  -  i(S)  +  K  . 


The  unconditional  expectation  of  the  loss  during  (t,  t+  1),  that  is, 
the  expectation  of  >?(y^),  with  y^  as  a  random  variable,  will  be 
denoted  by 


(4.7) 


4 ' • 


V.'e  shall  write  rather  than  only  v/hen  we  need  to  emphasize 

the  dependence  of  on  tlie  initial  stock  level.  Clearly  Iq^y)  ^  Xiy 
for  every  value  y  of  yg. 

Figure  5  shows  a  possible  type  of  graph  for^(y^). 

i(yt)t  ‘ 


Figure  5 


A 
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4:0  We  now  introduce  the  concepts  of  a  discount  factor,  CX-, 
and  of  "present  value"  of  a  loss.  If  the  value  of  y*.  is  given, 

the  present  value  at  time  tQ  of  the  expected  loss  incurred  in  the 
interval  (t^  +  t,  t^  +  t  +  1)  is  0^^^^ P(yt^+t 0  “ 

maximizing  expected  utility,  the  policymaker  takes  i-«to  account  the 
"present  values"  of  losses,  not  their  values  at  the  time  v/hen  they 
are  incurred.  In  commercial  practice,  OC  is  equal  to  unity  minus 
an  appropriate  market  rate  of  interest.  In  non-profit  practice,  OL 
would  have  to  be  evaluated  separately.  Later  it  will  be  shown, 
however  (see  Section  5:B),  that,  under  certain  conaitions,  the  optimal 
values  of  the  parameters  S,  s  can  be  found  for  QL  essentially  equal 


to  1  . 


If  v/e  now  define  the  function 


L(y)  =  ij(y) 


we  see  from  definition  (4.7)  that  l'(y^)  is  the  present  value  at  time  t 
of  the  total  expected  loss  incurred  during  the  period  (t,  t+  1)  and 
all  subsequent • periods  when  y^  is  given.  By  definition  L(y)  involves 
the  parameters  S  and  s;  and  the  policymaker  fixes  these  parameters  so 
as  to  minimize  u{y^). 

4:i:i  how  suppose  yg  is  given.  For  a  fixed  value  of  y^  ,  the  present 
value  of  the  total  expected  loss  over  all  periods  is 

(4.B)  /(yg)  *aMy^)  [i(y2)]  r^{y30  *•*  » 


where  we  have  used  Ey  denote  the  conditional  expectation  of 


10  rioverr.ber  1950 
Page  29,  F-189 


JLiy^)  f  given  the  fixed  value  .  Now 

Ey^C^(yr^]  "  r  =  1,  2,  •••  ^ 

because  of  the  fact  that  if  y^  is  fixed,  the  subsequent  value  y^, 
r  *  1,  2,  • * • ,  is  connected  with  y^  in  the  same  manner  that 
is  connected  with  y^  if  y^  is  not  specified.  Therefore  the  expression 
(4.i5)  is  equal  to 

(4.9)  /(yq)  -^ocjQiy^}  +a^i^(y-,)  +a^/2^yi^  “*  “ 

/ 

/(Yq)  *  (X-[lQ(y^ )  +ai^(y^)  +(x‘^J2(y^}  +  •  •  •]  = 

/(Yq)  +a-L(y^)  . 

I  I 

The  total  expected  loss  over  all  periods  from  the  beginning,  which  by 
definition  is  Lly^j)  ,  is  the  expectation  of  the  expression  in  (4*9) 
with  y^  regarded  as  a  random  variable.  Hence 

(4.10}  L(yO^  =  /(Yq)  +aE|L(y^)3  . 

To  express  the  expectea  value  of  h(y^ )  as  a  function  of  Yq  we  note  that 
if  y^  <  s,  then  Zq  =  S  and  y^  =  max  (S— Xq,  0);  while  if  Yq  >  s,  then 
Zq  ■  Yq  iind  y^  *  max  (y^^  “  »  0).  Thus 

n  S 

(4.10»)  £-[L(yi)]  =  L(S- x}dF(x)  +  L(0 }  [l  -  F(S  )]  f  or  y^  <  s  , 

y 

E[L(yi)]  =  °  L(y^-x)dF(x)  +  L(0)  [l  -F(yQ0  foryQ>s. 
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(Notice  that  from  the  way  v;e  have  defined  the  rule  of  action, 

L(y)  is  constant  for  0  <  y  <  s  so  that  L(0)  is  unambiguously 
defined.)  Putting  yQ  *=  y  we  obtain  from  (h.lO)  and  (4.10^  the 
equations 

(4.11)  L(y)=i{y)+a/  L(S- x)dF(x)  +  aL(j)  Q  -  F(S)]  if  y  <  s 

Jo- 


y 

(4.1:^)  L(y)  =  i(y)  +  L(y-x)dF(x}  +  aL(o)  [l  -  F(y )]  if  y  >  s 


Our  problem  is 
(4.12);  and  to 
It  is  not 
are  measurable 


to  find  the  function  L(y)  that  satisfies  (4.11), 
minimize  L(y)  with  respect  to  S,  s. 
difficult  to  show  that  L(y)  and  it(y)  for  each  t 
functions  of  y,  but  we  leave  such  technicalities 


aside . 
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5 .  H  Dynamic  Model:  Method  of  Solution 

5:a  In  treating  the  equations  (4.11)  and  (4»1^)  we  drop  for 
the  time  being  the  assumption  that  F(x)  has  a  density  function 
and  assume  only  that  the  random  variable  x  cannot  take  negative 
values.  In  order  to  take  care  of  the  possibility  that  F(x)  has 
a  discontinuity  at  x  *  0  (i.e.,  a  positive  probability  that  x  =  0) 
v/e  adopt  the  convention  that  Stieltjas  integrals  of  the  form 

(  )dF(x)  will  be  understood  to  have  0—  as  the  lower  limit.  We 
continue  to  assume  that  /(y)  is  given  by  (4*5)  but  it  is  clear 
that  a  similar  treatment  would  hold  for  c^ny  non— negative  function 
Ji(y)  v;hich  is  constant  for  0  <  y  <  s  ana  satisfies  certain  obvious 
regularity  conaitions. 

Since  £(y)  and  L(y)  are  independent  of  y  for  ^<y<s,  {4.11) 
tells  us  simply  that 

nS 

(5.1)  L(o)  =  i(0)  +0t/  L(S-x)di- (x)  +  aL(0)  [l  -  F(S)]  , 

t/Q 

v/hile  putting  y  =  S  in  (4.1.^)  gives 

n  S 

(5.2)  L(S)  -  i(S)  +  a  /  L(S-x)dF(x)  +  oa(0)  [l  -  F(S)]. 
Subtracting;  (5.2)  from  (5»1)  we  obtain,  using  (4.6), 


(5.3) 


L(0)  -  L(S)  -  K  , 


an  expression  v/hich  is  in  fact  obvious  since  if  tlie  initial  stock 
is  0  we  immediately  order  an  amount  S  at  a  cost  K  for  ordering. 

We  shall  solve  the  equation  (4.12)  for  the  function  ^iy),  considering 
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L(o)  as  an  unknown  parameter,  and  then  use  (5*3)  to  determine  L(0). 

On  the  right  side  of  (A*12}  we  make  the  substitution 

y  y““S  "y 

(5.4)  r  L(y-x}dF(x)  =  P  L{y-sjdF(x)  +  L(u)  P  dF(x)  ; 

U  0  do  0  y—s 

the  last  term  follows  from  the  fact  that  L(y  — x)  =  L(0)  when 
0  <  y  —  X  <  s.  Now  make  the  change  of  variables 

(5.5)  y  -  s  =  )^  , 

L(y)  =  L()^  +  s)  =  AO^)  . 

Putting  (5.4)  a.nu  (5.5)  in  (4.1k)  gives 

(5.9)  s)  +aL(u)£i  -  F(r()]  A(''|  -  x)dF(x) ,  r\>o, 

equation  (5.b)  is  in  the  standard  form  of  the  integral  equation  of 
renewal  theory;  see,  for  example,  Feller's  paper  [4j.  The  solution 
of  (5.6)  can  be  e^.pressed  as  follows.  Define  aistribution  functions 
F^(x)  ,  n  =  1,  2,  ***,  (the  convolutions  of  F(x))  by 

(5.7)  F^(x)  =  F(x), 

-JP  • 

Define  the  function  )^(x) 

H^(x)  =  i:od"F  (x), 

^  n  =  1 


(  5.B) 


0  <  OC  <  1  . 
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It  is  not  difficult  to  verify  that  the  series  in  (5 •8)  converges 
for  any  value  Qf  CL,  less  than  1  or  not.  Putting 

(5.9)  R(<^)  =  +  s)  +  CXL{0)  [l  -  F(a)]  , 

we  can  v/rite  the  solution  of  (5.8)  as 

A 

(5.10)  A()q)  =  H(r()  +  lt(r(  -  x)dHQ^(x) 

'  '  CO 

=  R(n)  +  21  OL^  I  R(n  -  x)dF  (x)  . 

n=1  do  ^ 

In  terms  of  L  and  i,  (5.10)  gives 

(5.11  )  L(y)  =  i(y)  +aL(u)  [l  -  F(y  -  s)] 

{^(y-^)  ■*’^)-(0)  [t-F(y-x-s)jJ'dH^(x)  ,  y> 
Fro.ii  (5*3)  und  (5.11)  we  have 

n 

(5.1.3)  L(0)  -  h  =  i(S)  +  /(S-x)dHQ^(x) 

+  aL(o)|l  -F(S  -s)  ^  ^  [1  -F(S-  s  -x)]dH^(x)|  . 


In  (5.12)  we  have  a  linear  eriu-tion  which  we  can  solve  for  the 
unKf.own  ^’uantity  L(0)  \;hich  has,  as  we  shall  show,  a  nonvanishing 
coefficient  in  (5.12).  This  gives  us  trie  value  of  L(y)  for  y  <  s, 
and  \ve  can  obtain  i-.(y)  for  y  >  s  from  (5.11),  since  every  term  on 
ti.e  right  side  of  that  equation  is  iiow  known. 
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The  coefficient  of  L{0)  in  (5*12)  is 
(5.13)  1 


-(X.|l  -F(S-s)  ^[l  -F(S-  s-x)]dHQ^(x)| 

-af- 


F(S-s)  +  H^(S 


-s)-y^  F(s- s- x)d)^(x)  I* 


00 


00 


=  1 -a^l -F(S-s)  +  X.CX^F^+i  (S- s) 


n  *  1 


n  =  1 


n+1 


=  (1  -  OO  [1  +  H^(S  -  a)]  . 


Using  (5.13)  we  obtain 

„  n  6— s 

K  +  i(S)  +  J  i(S  -  x)dHQ^(x) 


(5.14)  L(0) 


(1  -  a)D  +  H^(S  -  s)] 


Knowing  L(y)  from  (5.11)  and  (5.14),  the  next  step  is  to  find, 
for  a  'iven  initial  stock  y^,  the  values  of  s  and  S  which  minimize 
Lly^).  Vie  shall  consider  only  the  minimization  of  L(0),  although 
the  procedure  could  be  worked  out  to  minimize  l>(yQ)  for  any  initial 
stock  Yq.  The  procedur-e  of  minin.izing  L(0)  is  not  quite  so  special 
as  it  may  appear.  Suppose  that  for  a  given  yQ  the  values  of  s  and 
S  which  minimize  b(yQ)  are  .denoted  by  s  ( yQ )  and  S  (yg).  If 
s  (0)  >  0  and  if  s  (y^)  «nd  3  (Yq)  are  continuous  functions  of  Yq 
(a  point  which  we  have  not  investigated  mathematically),  then 
s  (yg)  ®  s  (O)  for  sufficiently  small  yg.  To  see  this  we  write 


b(y  )  =  L(y  ;  s  ,  S  ) 
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to  indicate  the  dependence  of  L  on  s  and  S.  Let  I  =  [a ,  bj  be 
a  closed  interval  with  0  <  a  <  s  (0)  <  b.  Take  jtq  small  enough 
so  that  s  (Yq)  is  in  I.  Now  if  is  sufficiently  small 

^(/q;  s*(yg),  s’‘'‘(yQ))  »  min  L{y^;  s,  S)  = 

3>s 

K  +  min  L( S ;  s ,  S ) , 
s6l 
S>s 

which  is  independent  of  Yq,  Q.E.D. 

In  5:B  an  optimization  criterion  will  be  given  which  is 
independent  of  the  initial  level  Yq. 

\\e  now  re— introduce  the  assumption  that  F(x)  has  a  probability 
density  which  is  continuously  differentiable, 

F(x)  «  f(t)dt  . 

V/e  recall  fro.n  (L.5)  that  l(y),  for  y  >  s,  is  given  by 
JHy)  =  a  [l  -  F  ( y )  J  +  cy  . 

Consider  the  mLniraization  of  (5.14)  with  respect  to  s  and  S. 
First  we  consider  the  case  where  S  —  s  is  fixed.  The  denominator 
of  (5.14)  involves  3  and  s  only  as  a  function  of  3  —  s.  We  therefor 
have  to  miniraize  the  numei^ator  of  (5.14)  with  i-espect  to  S,  subject 
uo  the  constraint  that  3  is  at  least  as  grdat  as  the  fixed  value  of 
3  —  s.  If  the  minimum  value  does  not  occur  for  3  *=  3  —  s  (i.e., 
s  =  0 )  ,  it  occurs  at  a  value  of  3  for  which  the  coi.ditions 
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n 

(5.15)  C  -  Hr(3)  +  [c  -  Ar(S  -  x)]dHjx)  =  0  , 

p  S-s 

(5.16)  -Af’(S}  iif»  (s  -  x)dHQ^(x)  >  0, 

hold.  It  should  be  noted  that  K  does  not  enter  into  (5.15)  and 

(5.16)  . 

If  we  drop  the  requirement  that  S  —  s  be  fixed,  then  s  and 
S  ,  proviaed  tney  satisfy  the  condition  0  <  s  ^  S  ,  occur  at  a 
point  where  equation  (5.15)  holds,  together  with  the  equation 
obtained  by  setting  the  derivative  of  (5.14)  with  respect  to  S  —  s 
equal  to  0,  taking  the  appropriate  second— order  conditions  into 
account.  'Ae  also  need  here  the  assumption  that  H^(3t)  is  the  integral 
of  a  function  h^(x), 

‘J'q  V*-*''*'  • 

Then  differentiation  of  (5.14)  v;ith  respect  to  S  —  s  gives,  setting 
the  derivative  equal  to  0, 

p3—s 

(5.17)  a[F(S)  -  F(s)]  =  c(S  -  s)  +  K  +  [c  -  ^if  (  3  -  x  )]  H^{  x  )  dx  .■ 

Presumably  the  minimization  of  (5.14)  would  be  accomplished  in 
practice  by  numerical  methods. 

5:B  3o  far  we  have  considered  (X  as  an  arbitrary  parameter. 

It  is  clear  that  if  we  let  OL  — >  1 ,  keeping  s  and  b  fixed,  the 
quantity  L(u)  becomes  infinite.  However,  as  v;e  shall  see,  the 
quantity  (1  —  CX)L(O)  approaches  a  finite  limiting  value  v;hose 


16  November  1950 
Page  37,  P-1 69 


significance  can  be  explained  as  follows.  Suppose  that  levels  s 
and  S  have  been  fixed  and  that  is  given.  V.e  have  mentioned  that 
the  quantities  then  form  a  Markovian  ranoora  process.  Moreover, 
the  probability  distribution  of  y^,  as  t  — >  oo,  approaches  a  fixed 
limiting  aistribution  which  is  independent  of  yQ.  (See  heller,  r5j, 
Chapter  15,  for  the  relevant  theory  when  P(x)  is  a  step— function. 

The  general  case  is  more  difficult  and  the  proof  requires  restrictions 
on  F(x),  which  are,  however,  not  of  practical  importance.  See 
Doob  This  implies  that  the  expected  loss  in  the  interval 

(t,  t+  1)  approaches  a  limiting  value  which  is  independent  of  Yq. 
(The  losses  during  successive  time  intervals  form  a  sequence  of 
bounded  random  variables.)  as  we  shall  see,  we  can  find  the  value 
of  Then  if  we  do  not  want  to  use  a  discount  factor  OC,  one  way 

to  proceed  is  to  pick  s  and  S  so  as  to  minimize  This  is  almost 

eouivalent  to  minimising  the  total  expected  loss  over  a  long  finite 
time  interval. 

nnother  way  to  look  at  the  situation  is  as  follows.  The  limiting 
distribution  of  y^  for  large  t  is  a  ‘'stationary  distribution";  i.e., 
if  Yq  has  tnis  distribution,  instead  of  being  fixed,  then  y^  has  the 
same  aistribution  for  every  t.  The  expected  loss  during  (t,  t+  1), 
if  y^  has  this  distribution,  is  just 

Since 


L(U)  =  iQ(0)  +  0/^(0)  + 


and  as  t  — >  ca,  we  have 

(5.16)  L(u)(i-a)  =  /q(o)  +  api  (0) -/q(o)]  +  a  "  A  * 
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The  series 

iQ(0)  +  “4(0)]  +  [4(0)  -4(0)]  +  ••• 

converges  to  the  value  4  and  therefore,  by  a  standard  result  of 
analysis,  we  have  from  (5*13), 

lim  L(0)  ( 1  -  a)  “I  • 

a— ^  1  “ 


In  order  to  determine  J.  ,  we  can  then  multioly  the  rie-ht  side  of 

(Xl  * 

(5*14)  by  (1  —  oO  and  let  OL — >  1,  obtaining 


(5.19) 


K  +  i(S) 


1  H(S  -  s) 


X )dH(x) 


where  H(x)  is  defined  by 

H(x)  =  lim  H  (x)  =  ^  * 

OL — >  1  ^  n  =  1  " 

(It  is  not  hard  to  see  that  the  step 

lim  ^i(S  -  x)dH^(x)  =  p'"  -  x)dH(x) 

a — >  ^  u  0  ^  <0  0 

is  justified.) 

\ie  can  then  minimize  the  function  in  (5.19)  with  respect  to  s 
and  S.  It  should  be  noted  that  4  is  of  course  independent  of  the 
initial  stock  yg. 
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6.  a  Dynamic  Model:  Examples 

</^e  consider  nov;  some  examples  for  a  particular  function  F(x). 

It  is  aovantageous  to  use  a  function  whose  convolutions  can  be 
written  explicitly.  From  this  point  of  view  functions  of  the  form 

( 0 . 1  )  F  ( X  J  =  - — ^ - P  u^^e^  du,  k>U,  (3  >  O  , 

are  convenient  |{k  — 1)1  is  P{k)  if  k  is  not  an  integerj  since  by 
proper  cl.oice  of  j2  and  k  we  can  give  any  desired  values  to  the  mean 
and  variance, 

X  «=  k/p  ,  x^  -  (x)^  =  k/p""  , 


and  since  is  then  given  by 


nk 


F^(x)  - 
^  (nk 


-  n  ^nk-1 

k  -  1  )  I  J  0 


, 

e  QU  . 


The  function  H^(x)  is  then  given  by 


(6.2) 


„x 

V^’  ‘/o  ® 


CO 

Z  - 

n“=1  (nk 


n  nk— 1  ") 

- Idu  . 

k  -  1)1  J 


If  k  is  an  integer  the  summation  in  (6.2)  can  be  performed  explicitly 
giving 

JA  X  -/Su 


(6.3) 


k  co^.  Ct^^/Su' 

^0)^6'^  )  du 

J“1  ^ 


where  are  the  roots  of  unity.  For  example,  if  k  =  2, 

we  have  "“1  ,  ^2  "  1  »  so  that 
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e  (e  -e  j  du  . 

It  is  instructive  to  find  the  value  of  /  for  the  simple  case 

CO  ^ 

f(x)  =  e  In  this  case,  from  (6.3), 

'0 


H(x)  ^  ®  ^(e^)du  =  X 


and  we  have 


3— 3 


L 


K  +  i(S)  +  i(S  -  x)dx 


1  +  3  -  s 


,  S— s 


K  +  c3  +  ae  + 


dx 


1  +  S  -  s 


K  +  cS  ■*•  ne  "*  +  c(3-s)  -•|(3-s)~  +  «e  ‘^(e'^~®-1) 


— S  /  3— s 


1  +  S  -  s 


K  +  c3  +  ive  ^  ~  s  ) 


1  +  S  -  s 


Letting  3  -  s  =  ^  ,  Me  see  that  this  expression,  for  a  fixed  value 
of  ^  ,  has  its  tninimura  (unless  it  occurs  v/hen  s  =  0)  when 

^  =  logg  (^)  -  loggd  A )  +  A  • 
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7.  Further  Problems  and  Generalizations 

To  make  the  dynamic  model  more  realistic  certain  generalizations 
are  necessary.  We  shall  register  them  in  the  present  section,  as 
a  program  for  further  v;ork. 

7; A  Of  the  several  cost  and  utility  parameters  used  in  the 
certainty  model  of  Section  2,  and  in  the  staLic  uncertainty  model 
of  Section  3»  v/e  have  retained  in  the  dynamic  uncertainty  model 
only  three:  c,  the  marginal  cost  of  storage;  K,  tlie  constant  cost 
of  handling  an  order;  and  A,  the  constant  part  of  the  depletion 
penalty.  A'e  have  thus  dropped  the  parameters  a,  bQ ,  b^  ,  and  B. 

The  meaning  of  the  first  three  of  thesf;  was  discussed  in  sub— section 
6:B.  It  can  be  presumed  from  the  equation  (3»8)  of  the  more 
developed  static  model  that  if  we  similarly  developed  the 
dynamic  model,  c  could  be  easily  replaced  by  (c  +  bgj;  but  that 
(B  +  a),  would  form  an  adaitional  piarameter,  altogether  excluded 
from  our  simple  aynamic  model.  Difficulties  of  another  kind  will 
occur  when  b^  >  0,  i.e.,  when  there  are  economies  of  bi^ — lot  buying, 
which  are  due  not  to  the  uCivar.tage  of  i.andling  one  order  instead  of 
many,  but  to  the  cheapness  of  transporting  (and  prooucir.g)  large 
quantities.  This  will  obviously  modify  the  rule  of  action  (4.4), 
as  the  loss  that  we  intend  to  minimize  will  depend  on  (3  —  y^), 
the  size  of  the  replenishment  order. 

7:B  Another  direction  in  which  the  uynamic  model  must  be 
generalized  to  become  realistic,  corresponds  to  sub— section  2:F  of 
the  certainty  model.  The  cost  of  ordering  may  be  a  periodic  function 
of  time,  due  to  existing  schedules  of  transportation  and  administrative 
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routine.  In  our  dynamic  model,  orders  (zero  or  positive)  can  be 

given  at  the  beginning  of  eacli  period  of  length  6q  “  1  ,  the  cost 

K  of  a  positive  order  being  constant.  Suppose,  however,  that 
0 

instead,  K  =  K  at  iristants  0,  ,  2ra6Q ,  •**,  where  ra  is  an  integer; 

-f  -f  o 

and  K  =  K  at  ail  other  instants,  with  K  >  K  .  For  example,  if 

8q  is  one  day,  m^Q  may  be  one  week,  and  instant  0  is  the  first 
iionday.  Given  the  other  paraiaeters ,  it  may  or  may  not  be  advantageous 
to  place  orders  on  Mondays  only.  Moreover,  the  integer  m  may  itself 
be  a  controlled  variable:  e.g.,  one  may  have  to  decide  v.'hether  to 
make  the  orders  daily,  weekly,  or  monthly,  a  month  not  being  an 
integral  multiple  of  a  week,  and  the  cost  of  a  ;iionthly  order  being 
different  from  t;.at  of  a  weekly  order. 

7:G  The  aggregation  problem,  treated  for  the  case  of  certainty 
in  tiie  last  three  sub— sections  of  Section  2,  arises  of  course  also 
in  the  case  of  uncertainty.  The  problem  is  important  because  the 
nuinaer  oi  iteias  hanuied  ay  any  xcirge  organizatiori  (excef)ting  possibly 
so.ne  hij.niy  specialized  ones)  ivS  usually  vei’y  large;  and,  usually, 
only  large  organisations  ai'c  equipped  to  impleir.ent  an  inventory 
policy  approxin.ating  the  optiiial  one,  since  it  presupposes  either 
a  goou  r^nov. ledge  of  the  relevant  parameters,  or  their  statistical 
estimation . 

7:D  V.e  iiave  assumed  the  uistribution  F(x)  of  uemand  per  unit  — 
period  to  be  ..nown  -  resuixiably  estimated  from  orevious  samples, 
iictuai  estimations  of  this  uistribution  were  carried  out  by  try  for 
the  Bell  Teleohore  Co.apany  (see  ..ilson  ^lOj),  and  by  Kruskal  [7^ 
wit),  the  material  of  tlie  medical  brancii  of  the  U.  S.  Navy. 
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Inventory  policies  based  on  such  estimates  can  be  improved 
as  the  operations  are  going  on.  The  logic  of  such  ''sequential” 
procedure  can  be  outlined  as  follows: 

Using  the  dynamic  model  of  Section  4  with  s  and  S  as  the 
controlled  parameters,  now  permitted  to  vary  with  time,  denote  by 
/"lS  ( t )  ,  s  (t }  ;Fj  the  expected  loss  over  an  infinite  period, 
given  the  non— controlled  parameters  A  and  K,  but  v/ith  the  distribu¬ 
tion  F(x)  unknown.  Denote  by  “  (x^,...,  )  the  sequence  of 

past  observations  on  demand  (fulfilled  or  not).  Find  two  functions 
S  *  ^  *  ®t  ^^t^  that  would  produce  the  best  results. 

The  best  results  can  be  defined  as  follows.  The  expected  loss 
depends  on  the  functions  S^,  s^  and  on  the  unknown  distribution 
function  F,  and  can  be  written  as  the  functional  on  S,  s,  F, 

(X^),  s^  (X^);  F]  =/*(S,  s;  F)  . 

It  is  assumed  that  the  distribution  F  belongs  to  some  class 

specified  in  advance.  The  criterion  for  the  most  appropriate 

choice  of  policies  in  cases  such  as  this  are  still  a  matter  of 

dispute.  One  suggestion,  inspired  by  '..aid's  statistical  writings, 

is  that  Nature  should  be  visualized  as  having  chosen  F  so  as  to 

maximize  the  loss;  the  aim  of  the  inventory  controller  —  or  any 

other  planner  —  should  then,  in  accordance  with  the  theory  of  games, 

be  to  minimize  the  maximum  loss.  Professor  Leonard  J.  Savage  has 

pointed  out  that  it  would  be  better  to  regard  the  penalty  to  be 

assessed  against  the  planner  as  not  the  total  loss  but  only  that 

part  which  is  due  to  his  ignorance,  the  "regret”.  This  is  defined 
as  the  difference  between  the  minimum  expected  loss  in  the  case 


ii 
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tion  are  its  opponents  and  liave  the  choice  of  demands  , 
within  a  certain  range.  If  they  are  rec.uired  to  choose  F  at  the 
beginning  of  the  operation,  then  the  proper  rule  is  to  choose 
the  functions  S,  s  so  as  to  minimize 

max  A  ( S ,  s  ;  F  J  . 

F 

However,  there  are  other  possibilities.  for  example,  the  opponent 
might  be  permitted  by  the  rules  of  the  game  to  choose  x.  at  each 
time  t.  Then  the  specification  of  the  game  wil]  have  to  be  com¬ 
pleted  by  a  statement  of  the  enemy’s  information  pattern  and  the 
costs  to  him,  if  any,  in  choosinr  the  various  values  of  x  . 
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that  the  organization  knew  the  distribution  F,  and  the  expected 
loss  resulting  from  its  actual  decision.  Given  F,  the  minimum 


expected  loss  is 


min  /*(S,s;  F)  = /*  (F),  say  . 


The  "regret”  is 


=  /'(S,s;  F)  -/*’■'  (F)  =  r(S,s;  F), 


The  optimal  stock  control  functions  ®t  ^^t^  best 

estimator  of  the  distribution  F  =  F^  (x,  X^)  must  satisfy  the 
condition 

r(3  ,  s  ;  F  )  =  min  max  r(S,  s;  FJ  . 

S,s  F 

Another  proposal,  much  more  traditional  in  probability  theory,  is 
to  assume  that  the  planner  has  some  psychological  probability 
distribution  G  over  all  possible  distributions  F,  representing  his 
relative  degrees  of  belief  in  their  occurrences.  The  distribution 
G  reflects  past  experience  and  general  judgment.  Then  the  optimal 
procedure  is  to  choose  the  functions  6  and  s  so  as  to  minimize  the 


expected  loss, 


J  >(S,s;  F)dG 


Whether  some  kind  of  rainimax  criterion  is  adopted  or  a  psychological 
probability  approach  is  taken,  it  is  easy  to  see  that  the  solution 
will  call  for  functions  S,  s  which  really  depend  on  the  observations 


.  However,  the  determination  of  these  functions  is  still  an 
unsolved  problem. 

Another  case  is  that  in  which  the  ’’customers”  of  the  organiza— 
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